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^ data to be transmitted is employed. To counteract intersymbol interference due to signaling faster than the Nyquist Rate, equalization 
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1 fflGH-SPEED TRANSMISSION SYSTEM FOR OPTICAL CHANNELS 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This Application claims priority fiom Provisional Application 60/177,034 entifled HIGH 
5 SPEED TRANSMISSION FOR OPTICAL CHANNELS filed on 1/17/00, which is 
incorporated by zdfer^ce herein as though set forth in full. 

FIELD OF THE INVENTION 

The present invention relates generally to apparatus and mettiods for high speed data 
1 0 transmission over optical diannels, and, in particular embodiments, to transmission of data using 
pulse amplitude modulation, trellis coding, and equalization techniques. 

BACKGROUND OF THE INVENTION 

The demand for higher capacity data transmission systems continues to increase. To 

1 5 satisfy the ever increasing demand for more data transmission capacity higher ba\id rate systems 
such as optical channels have been used. At high baud rates some optical fibers may exhibit 
phenomena such as miiltimode transmission characteristics and intersymbol interference, v^hich 
can limit the signaling rate available on that fiber. Therefore, there is a need within the art for 
methods and apparatus that are c£^able ofhigher baud rates, and for those \^^ch can compensate 

20 for the problems encoimtered witii high speed data transmission. 

SUMMARY OF THE INVENTION 

In one aspect of the invention, an £pparatus for transmitting data on a fiber optic channel 
is disclosed. The apparatus comprises a trellis encoder that accepts data to be transmitted, applies 
25 a convolutional coding to a portion of the data, and produces a trellis coding of the data to be 
transmitted. A subset mapper accepts the trellis coding and produces a plurality of pulse 
amplitude modulated (P AM) symbols fiom the trellis coding. A Tomlinson precoder accepts the 
PAM symbols and applies a Tomlinson precoding the PAM symbols. A converter converts the 
PAM symbols into a form for coupling into a fiber channel. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other features, aspects, and advantages of the present invention will become 
better understood with regard to the following description, appended claims, and accompanying 
drawings where: 

35 Figure 1 is a block diagram illustrating components of an optical data commimication 

system. 

Figure 2 is a block diagram of a optical communication system according to an 
embodiment of the invention. 

-1- 



SUBSTITUTE SHEET (RULE 26) 



wo 01^17 



PCT/USOiy01532 



1 Figure 3 is a blodc diagram illustrating a fiber optic transmitter according to an 

embodiment of flie invention. 

Figure 4 is a graphical illustration of Tomlinson-Harashimaprecoding (THP). 
Figure 4a is a grs^hical illustration of the mapping of excess pulse amplitude modulation 
5 levels which are produced by a Tomlinson-Harashima precoder. 

Figure 5 is a block diagram of a receiver, according to an embodiment of the invention. 
Figure 6 is a simplified block diagram of a receiver^ vMct contains a decision feedback 
equalizer (DFE). • 

Figure 7 is a graphical illustration of the impulse response of an exemplary fiber channel. 

10 

Figure 8 is a blodc diagram illustrating a fiber chaimel model used in conjimction with a 
laser model based on the rate equations. 

Figure 9 is a graph representing of the impulse response of a linear system having a 
Gaussian impulse response. 
1 5 Figure 10 is a graph illustrating an output of a laser model based on the rate equations. 

Figure 1 1 is a gr^h illustrating an e)q)anded portion of the gr^h illustrated in Figure 1 1 . 

Figure 12 is a graph offhe simulated output of the laser model of Figure 10 after passage 
through a simulated channel. 

Figure 13 is an eye diagram of a simulated recdver equalizer, illustrating a transition 
20 between a bilevel training mode and receiving P AM-5 symbols. 

Figure 14 is a gr^h of a magnified portion of the graph of Figure 13, illustrating the 
convergence of the equalizer during a training sequence. 

25 DETAILED DESCRIPTION OF THE INVENTION 

The demand for higher data carrying capacity transmissions systems continues to increase . 
Accordingly, embodiments of the present invention relate to methods and apparatus for 
increasing the rate of data transmission in optical transmission systems. 

Figure 1 is a block diagram illustrating a prior art optical data communication system. 
30 InFigure 1 adatasource 101 provides data to be transmitted over fiberoptic channel 109. 

Data source 101 may be, for example, the Internet, a cable television head end, a corporate 
network or a variety of other data sources. 

Data firom data source 101 is provided to an encoder 103, which encodes the data. 
Encoding may encompass representing the input data fi'om the data source 101 in a variety of 
35 ways. In the exemplary system of Figure 1 the data encoding comprises translating the data 
received onto a series of OOK (On Off Keying) symbols for transmission using a laser. OOK 
represents the data as a series of on-off pulses or two levels of optical intensity. 

Once the data is encoded, the encoded signal is coupled into an optical channel driver, 
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1 such as a laser drivexl OS, v^dicontn>b the intensity of a lase^ The output oflaser 107 is 
coupled into a Wxi optic channel 109. The fiber optic channel is further coiq)led to an optical 
receiver 111. The optical dumnel 109 may be of various l^ig&s depending upon the plication. 

5 The optical receiver 111 accepts &e signal provided by the fiber optic diannel 109 and 

converts it into an electrical signal. Hie electrical signal, representing the transmitted data, is 
provided to an OOK data decoder 1 13. TTie data decoder 113 reverses the process of the encoder 
103 and recreates the data provided by the data source 101. The data fiom the decoder may be 
then routed, for example using a data router 1 IS, to various user devices. An exemplary user 

10 device 117 then receives data, smdi as video data, firom the data router IIS. 

Figure 2 is a block diagram of an optical conununication system according to an 
embodiment of the invention. Transmitter 200 communicates with receiver 222 over channel 
213. In Figure 2 the data to be encoded is coiq)led into a trellis encoder 201. The trellis encoder 
201 includes convolutional coder 206 and subset m^per 203. The trellis encoder 201 may be 

15 a single trellis encoder or it may be a series of trellis encoders in parallel. 

The ou^uts of the convolutional cod^ 206 are further coupled into subset mappers 203 . 
A subset mapper accepts the convolutionally encoded signal and produces multilevel symbols 
20S as an output The multilevel symbols are then coiq)led into equalizers 207. The equalizers 
207 are used to compensate for the non-flat response of a channel 203. After equalizing the 

20 multilevel symbols, the equalizers provide the resultant symbols to one or more digital to analog 
converters (D/A) 209. Hie digit^ to analog converters 209 accept the equalized multilevel 
symbols, and convert ^em into analog signals. The analog signals are then coupled serially into 
anopticalsourcesuchasalaser21 1. The digital to analog (D/A) converter(s) provide successive 
signalstolaser21I during a second time period, and so forth. Mother words a signal from a first 

25 D/A converter may be provided to the laser 211 during a first time period, then a signal firom a 
second D/A converter may next be provided to the laser 2 1 1 . In such a manner multiple symbols 
from multiple data sources may be transmitted by the single laser 21 1. Alternatively, a single 
D/A converter may accept successive values &om multiple data sources, converting them into 
a series of analog values to be used to modulate the intensity of the laser output 211. 

30 The output of the laser 211, modulated by the analog representation of the multilevel 

symbols, is coupled into the optical channel 213. The optical channel 213 transmits the intensity 
modulated laser signal to an optical-to-electrical converter 215. The optical-to-electrical 
converter 2 1 5 accepts the optical signal from the chaimel 213 and converts it back to an intensity 
modulated series of electrical signals. The optical-to-electrical converter 215 then provides the 

35 amplitude-modulated signals to one or more analog-to-digital (A/D) converters 217. The A/D 
converters converts the series of analog signals to digital signals. The digital signals are provided 
to one or more trellis decoders 219 where the trellis-encoded digital signals are decoded. The 
output of the trellis encoders are provided to a physical coding sublayer (PCS) unit 221. A 
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1 physical coding sublayer (PCS) may provide bit manipulation, such as decoding, to the signals 
decoded by Ihe trellis decodo* 219. The data output of tiie PCS 221 is tfien provided to a user 
interface such as an XGMU (extended Gigabit Media Independent Inter&ce). 

niustradvely, the optical communication system depicted in Figure 2 has particular 

5 characteristics. For example, the channel 21 5 is considered to be a standard 62.5/125 fiber. 
Fiber is commonly spedJSed m terms of a bandwidfli times length product For a 62.5/125 \i 
meter fiber a typical bandwidth times length product i$ 500 MHz/km. 500 meters of such fiber 
would typically yield a 1 gigahertz bandwidth for a laser wavelength of 13 10 nanometers. 

To transmit a signal at or less than the Nyquist rate, tiie tniniiniiTn bandwidth must eqiial 

1 0 one half of the symbol rate of the channel. The Nyquist bandwidtii of a chaimel is the mavimiim 
rate at which signaling can occur on that chaimel without intersymbol interference (ISI). In other 
words, a system cannot transmit signals faster than tiie Nyquist rate without intersymbol 
interferenqe. However, an equalizer such as 207 can be used to remove intersymbol interference. 
Equalization in Figure 2 is shown within the transmitter 200. Such equalization is called transmit 

15 side equalization. Equivalentiy, equalization may be applied at ttie receiver 223, and either 
equalization may be non-linear. For example, decision feedback equalization (DFE) may be used 
at the receiver 223 . Although the equalization can be done equivalentiy on the transmitter as well 
as the receiver side, there are certain advantages to placing the equalizer in the transmit side. For 
example, if tixe equalization is placed within the receivix^ side, the trellis decoder and an 

20 equalizer must function concurrentiy. Concurrent trellis decoding and equalization is a 
complication within the receiver that can be avoided by having the equalization circuit in the 
transmittCT. It is di£5cult to combine an equalize and a trellis decoder, in a receiver, because 
such a receiver would have to decode the trellis while attempting to compensate for the 
intersymbol iiiterference. If the equalization is done in the transmitter, there is no necessity to 

25 compensate for intersymbol interference while decoding the trellis coding. 

Embodiments of the present invention may include, for example, a single trellis encoder, 
a single symbol mapper, a single equalizer etc. Alternatively, the same components may be 
replicated multiple times the signals time multiplexed from such parallel components in order 
to couple them in and out of a single fiber channel. To simplify the disclosure, however, the 

30 components will be illustrated as single components. Those skilled in the art will realize that the 
same components may be \ised in a variety of parallel configurations. 

For the purposes of example, the multilevel symbols 205 are considered to be part of a 
PAM-5 (pulse amplitude modulation - 5 level) alphabet. 

Figure 3 is a block diagram illustrating the fiber optic transmitter 200 according to an 

35 embodiment ofthe current invention. Detail ofthe transmitter 200 is illustrated in Figure 3. The 
trellis encoder 323 accepts a group of R bits from the data source 202. The trellis encoder 305. 
is a rate M/(M+1) convolutional coder of the R bits which are input to the rate m/CMH) encoder. 
R-M bits will be unencoded and M bits will be encoded. The ou^ut of the convolutional coder 
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1 305 con^mses (M+1) hits. The R-M xmencoded bits and the M + 1 coded bits, which are output 
fiom the convolutional coder 305 are provided to a subset niq)per 307. The subset mapper 307 
vaaps the received bits into a series of multilevel symbols 309, for example, PAM 5. The 
combination of convolutional coder 3 05 and the R-M unencoded bits conqmses a trellis encoder 

5 323. TbQ pulse an^litude modulated signals Ai through have 5 levels, but may have any 
number of amplitude levels, depending on the pulse amplitude modulation scheme chosen. 

The fiber optic channel, as discussed above, illustratively exhibits multimode transmission 
characteristics at axry Nyquist bandwidth of 1 GHZ. Accordingly, the bandwidth available in the 
channel is smaller than required to signal without intersymbol interference (ISI) at a 10 GHZ rate. 

10 To achieve the 10 GHZ signaling rate, the channel operate in the presence of intersymbol 
into&rence. One way to compensate for intersymbol interference is to use an equalizer in the 
receiver. For example, a decision feedbadc equalizer (DFE) may be used. The DFE is discussed 
in the receive section. 

A further way to con[ipensate for the effect of inter^mibol interference is to use a 

15 Tomlinsonprecoder311. 

In Figure 3 multilevel symbols 309 are provided to a Tomlinson Precoder for example 
in a 10 gigabit per second (GPS) transmission system implemented using a five level pulse 
amplitude modulation - 5 level (PAM-5) transmission scheme. The baud rate necessary to 
achieve a 10 GPS transmission is reduced to five gigabaud because each PAM-5 qmibol can 

20 represent five different values. 

There axe multiple advantages to reducing the baud rate by ^i^iT^g pulse amplitude 
modulation. One advantage is that the system can operate over multimode and limited bandwidth 
channels over greater distances than would be possible if on/off keying (OOK) were used. 
Another advantage, of using PAM instead of OOK, is that the PAM symbols can represent 

25 multiple bits of information. Accordingly, the speed of the electronic cuxiuits needed to create 
the transmitted signal at the transmitter is reduced. Consequently, the speed of the electric 
circuits needed at the receiver is also reduced. By reducing the required speed of the electronic 
circuits, technology such as CMOS (complimentary metal oxide semiconductor) may be used to 
implement the electronic circuitry. In contrast, high speed electronic circuits can often require 

30 expensive high speed technology such as gallium arsenide or indium phosphide. Because of the 
higher levels of integration presently available using CMOS, a greater level of integration is 
possible than with such technologies as gallium arsenide or indium phosphide, and so it is 
advantageous to use PAM symbols to decrease the signaling rate while keeping the baud rate 
constant. 

35 A potential disadvantage of using multilevel encoding such as PAM-5, instead of the more 

traditional on/off keying, is that a higher signal to noise ratio (SNR) may be required of the 
chaimel since OOK needs to represent only two levels whereas PAM symbols are multiple levels. 
By using multiple levels the distance between levels is reduced, over using two levels. Because 
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1 tbedistajicebetw^n levels is leduced the avaUa^^ Toreducethe 
required signal to noise ratio to a level eqinvalfflt to the OOK system, PAM-S modulation may 
be combined with trellis coding as illustrated in the embodiment of the invention illustrated in 
Figure 3. 

5 In Figure 3 a Tomlinson Harashima (Tomlinson) precoder 311 functions as a transmit side 

equalizer. A traditional equalizer in a receiver compensates for distortion and uneven fi^ 
response caused by the transmission channel. Including &e fiber on laser eqiialization, however, 
can be done equivalenily in a receiver or a transmitter. In either case flie resiilt is a signal 
characteristic tiiat, vAn&a combined with tbe channel characteristic, ideally results in a flat overall 

10 response. 

A problCTi with atten^ting to equalize a fibo: diannel is that tiie fiber may exhi^ 
In other words, the fiber channel transfer function permits very little signal transmission at a 
particular frequency. An equalizer, attempting to compensate for such nulls, nia/ require an hi^ 
gain to make up for the poor response of the channel. High gain may produce an imstable 

1 5 response in the equalizer. 

Tomlinson Harashima precoding may be used to compensate for fi:equency nulls within 
the channel. The output of the Tomlinson precoder 3 1 1 is provided to a Digital Analog (D/A) 
converter 313. The D/A converter produces an analog signal, which is used to modulate the 
intensity of the laser 211. The Tomlinson precoder is shown as a simplified representation in 

20 311. The Tomlinson precoder 311 may actually be a groi^ of Tomlinson precoders, each of 
which operates on one PAM-S symbol. The P AM-5 symbols thus generated are multiplexed into 
the D/A converter 313. 

Figure 4 is a gmphical illustration of Tomlinson-Harashima precoding (THP). In Figure 
4, Chaimel 41 1 A, which is identical to Chazmel 41 IB, can be described by a Z transform. The 

25 characteristics of Channel 41 1 A and 41 IB can be described by the expression "1+D(Z).*' The 
term "D(Z)" term is responsible for the intersymbol interference exhibited by the channel. If it 
is desired to compensate for the characteristic of the channel within the transmitter, a filter v^th 
a transfer characteristic inverse of the chaimel must be added. By implementing a feedback loop 
comprising the summation unit 405A and the feedback filter 407 A, a transfer characteristic of 

30 1/(RD(Z)) is created. The total response would tiien be 1/(1+D(Z)) times H-D(Z) resulting in 
a net channel characteristic of one, which is the combined response of the precoder and the 
channel. The combined response of the precoder and the channel is therefore a flat response 
which does not introdxice any dispersion, and therefore, the signal at the receiver 413A is 
equalized. 

35 -Difficulties can be encountered because at fi^quencies v^ere the channel has a lot of 

attenuation, the precoder will have a lot of gain to compensate for the attenuation. At such 
Jfrequencies, the precoder may become unstable. Therefore, in order to stabilize the precoder and 
to limit the amplitude of the signal out of the precoder, a signal represented by arrow 403 is 
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1 added to the sunmiation unit 40SA. = x M "wbext M is the number of levels being 
tzansmitted on ih& channel In the present embodiment, yAdch uses P AM-S , M has a value of 5 . 
M is essentially tiie maximum number of levels desired at the output Once the ou^ut signal of 
theprecoder, is computed, if the signal exceeds certain limits then V,, is subtracted &om the 

5 signal Y„ and K„ is the smallest integer that brings the ou^ut back into the desired range. 
There is always a value for that will meet this condition. M is essentially tbe iT»«xiTn]im 
allowable range of the output of the precoder. Depending on the value of there is a unique 
integer value that vriU bring the output oftheprecoder back within Thisisthe 
basis of Tdmlinson Harashuna Preceding (THP), In other words, the IHP does the inverse 

10 chaimel characteristic filtering then modifies the iiqsut to the sunmiation unit by adding an 
mtegral multiple ofMwfaidi at the output is bounded. The signal V„ is added to the iiq}ut The 
output of the channel sees a quantity equal to plus V^. In other words, the number of levels 
appearing at the receiver has been e^^ianded. Therefore, the slicer in the receiver must be able 
to distinguish + levels instead of just beting able to Hlfrfingiiish levels. One price for 

1 5 doing this type of equalization is the increase of the number of levels in the constellation at the 
receiver. Therefore, all that needs to be done in the receiver to recover the origiiialPAM-5 levels 
is to implement a wrap-around scheme sudi that the excess levels are wrapped around into the 
original PAM-5 levels. The wrap around is illustrated in Figure 4A, 

Figure 4 A is a graphical illustration of the mapping of excess pulse amplitude modulation 

20 levels produced by a THP, such as illustrated in Figure 4. In Figure 4A, 9 PAM constellation 
levels are present The correct PAM-5 levels, that is 435, 437, 439, 441 and 443 are present. In 
addition, levels 431 and 433 which are higher than the highest PAM level 445, are present. 
Additionally, levels 445 and 447 are present which are lower than the lowest level 443 are 
present. In order to map the 9 levels back into the original 5 levels, a modulo type add or subtract 

25 is done. In other words, if the level out to be remapped are above the maximum levels, a modulo 
5 value is subtracted. In the present case, 5 levels are subtracted from level 433, and accordingly 
level 433 maps into level 443 . Similarly, 5 levels are subtracted fi-om level 43 1 and level 43 1 
maps into level 441. Similarly level 445, which is below the lowest level of 443, has 5 levels 
added to it and level 445 is thereby mapped into level 435. Similarly, level 447, which is below 

30 the lowest level of 443, has 5 levels added to it and is thereby remapped into level 437. If for 
example 6 levels were present above level 435 then 1 0 would be subtracted from the 6* level and 
the 6* level above 435 would map into level 443. 

Referring to Figure 4 precoder 400B illustrates an alternate method of adding the 
correction fector Vn to the precoder. In precoder 400 A signal Y,, is examined and then a value 

35 for K„ is decided on and the value V„ is then added or subtracted in the summation unit 405 A. 
In reality the operation of creating the adjustment value V„ is nothing more than a wrap around 
operation The operation is comparable to the overflow in an accumulator. Therefore, in the 
precoder represented in 400B modulo block 4 1 7 is added. In the modulo M block 4 1 7, a wrap 
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1 aroxind operation is added to tibe piecodo: circuit and automatically accomplishes the adjustment 
accomplished by the summation fo tfie V„ signal in summation block 405 A in precoder 400A. 

One problem with Tomlinson precoding is fhat the number of levels in the receiver may 

5 grow depoiding on the channel characteristics. For example, in a P AM-S system the number of 
levels may grow to 15,20ormore. Theproliferationof levels in the receiver may be a problem 
because within the receiver is an A/D converter sampling Hie multiple received levels. In order 
to accommodate multiple levels, the resolution of the A/D converter can be adversely impacted 
because the levels must be scaled so that they fit within the range of the A/D. That is, the 

1 0 resolution of an A/D converter discriminating between 5 levels is much better than the resolution 
ofthat same A/D converter discriminating 15 levels. Therefore, adding levels can require a better 
A/D converter, that is one having more bits of resolution. It is therefore desirable to limit the 
number of levels presented to the receiver. The number of levels that are presented to the 
receiver can be accomplished by limiting the value of in precoder 400A. Such Ihniting may 

1 5 lead to certain points falling outside of the allowed levels, however in return for the points falling 
outside of the allowed levels, the number of levels presented to the receiver can be limited. This 
form of THP is referred to as Dynamics Limited Precoding (DLP). 

Precoding has several advantages over receive side equalization. One advantage is that 
a precoder lends itself to a better parallel implementation than receive side equalization such as 

20 Decision Feedback Equalization (DFE). Another advantage of receiver side equalization is that 
"wbsxi using trellis-coded modulation, precoding allov^ the trellis decoder to be substantially 
simplified, siace the decoder then does iK3t have to deal with int^rsymbol interference. The 
combination of precoding with trellis coded modulation can approach the Shaimon bound for 
channel edacity when good modulation codes are used. Therefore, the present architecture can 

25 provide a close to optimal architecture. 

Figure 5 is a block diagram of a receiver, according to an embodiment of the invention, 
illustrating the decoding of multiple signals transmitted across the same channel In Figure 5, 
a photo detector 501 accepts a pulse amplitude modulated signal from the fiber optic channel 
109. Thephoto detector 501 then provides a voltage signal, representative ofthe signal received 

30 from the fiber optic channel 109, to a pre-amplifier 503. The pre-ampUfier 503 amplifies the 
signal provided by the photo detector 50 1 to a suitable level. Pre-amplifier 5 03 then provides the 
amplified signal to a high pass filter 505. 

High pass filter 505 fimctions to prevent aphenomenon known as baseline wander. High 
pass filtering the input signal blocks low frequencies thus minimizing low frequency excursions. 

35 Photo detector 501, pre-amplifier 503 and high pass filter 505 generally define the optical 
receiver 111. The boundaries, however, between the optical receiver and decoder are somewhat 
arbitrary and other sources may define boundary line between these blocks differently. 

The output of high pass filter 505 is provided to a programmable gain amplifier (PGA) 
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1 507. The gain of the PGA 507 is controlled by an automatic gain control (AGC) circuit 508. 
AGC circuit 508 controls tiie gain of the anq)lifier 507 accordiog to signal levels at the output 
of the retiming block 511. The signal at the ou^ut of the PGA 507 conqmses a series of high 
speed pulse amplitude modulated voltage signals. Hie output of the programmable gain 

5 amplifier 507 is coupled into a plurality of interieaved analog to digital converters 509. 

The analog to digital converters (A/D) 509 are timed by a clock provided by the timing 
recovery circuit 515. Each A/D converter, however, receives its own phase of the clock in order 
to sample successive values using successive A/D converters. Because the values received by 
the A/D converters are sampled using a clock having different phases, retiming of the signals is 

10 necessary in order to create a synchronized parallel value. The retiming ofthe A/D saixq)les takes 
place inretiming block 511. Retiming block511 essentially comprises a clodced register circuit 
or equivalent By interleaving N A/D converters in the analog to digital block 509» the clock rate 
of each individual converter can be reduced by a &ctor ofN (over the use of a single converter). 
Without the interleaving of analog to digital converters 509 it may be difficult or impossible to 

1 5 fiabricate an analog to digital converter, Which could sample the input at a high enough rate, in 
order not to lose any successive values in the input data stream. By interleaving the A/D 
converters the necessity of using very high speed circuit technologies, such as gallium arsenido 
or indiimi phosphide may be avoided. 

Parallel values from the retiming block 51 1 are provided to a fine AGC module 513. The 

20 digital values of the synchronized parallel data can be examined in the fine AGC modules to 
detemoine whether the amplitude of the input signal is correct and to provide fine adjustments 
to the signal values. The timing recov^ block 515 may adjust the timing of the analog to digital 
converters. 

TTie output of the fine AGC block 5 13 is coupled into an N-dimensional trellis decoder 
25 519. An N-dimensional trellis decode- includes N trellis decoders. The number of trellis 
decoders will vary depending on a variety of implementation details. The N-dimensional trellis 
decoder 519 decodes the symbols accepted fiom the fine AGC module 513 and converts them 
into digital data values. 

Once the PAM-5 symbols have been decoded into bit patterns, they are provided to a 
30 physical coding sublayer (PCS) 521. The physical coding sublayer 521 provides bit 
manipulation, such as signal descrambling, etc. Tlie physical coding sublayer 521 then provides 
a resultant bit stream to a system interface 523. 

Figure 6 is a simplified block diagram of a receiver such as that iUustmted in Figure 5 
illustrating the addition of a DFE. The DFE in the receiver may be used instead of a Tomlinson 
35 precoder in the transmitter. Because equalization can be done equivalently in the receiver or 
transmitter the net equalization effect is the same. 

The block diagram of Figure 6 does not illustrate the parallelism of the receiver illustrated 
by Figure 5. Figure 6, however does provide detail on the addition of equalization, which may 
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1 be included in the receiver. A photonic signal is accepted by the detector 601. ThedetectoxdOl 
converts tiie received signal into a voltage and then provides the voltage signal to pre-amplifier 
603. Pre-amplifier 603 amplifies fte signal and provides it to high pass filter 605. A 
programmable gain amplifier 607 accepts the signal fiom the higlh pass filter 60S and provides 

5 it to an AID conveiler 609. 

The A/D converter 609 converts the analog signal from ibe high pass filter into a digital 
equivalent An AGC block 608 accepts the digital value &om the A/D converter 609 and 
controls the gain of the programmable gain anq>lifier (PGA) 607. The output of die analog to 
digital converter 609 is also provided to a fine AGC 613, where small adjustments in the signal 

10 aremade. Theou:^utofthefineAGC613isthenprovidedtoadecisionfeedbackequalizer625. 
In order to e)q}lain the operation of a decision feedback equalizer reference will be made to 
Figure 7. 

Figure 7 is a graphical illustration of the impulse response of an exemplary fiber channel. 
In Figure 7, point 719 represents a decision point v/hert the value of the waveform 729 is 

1 5 sampled. Since the mp^x^ waveform is an impulse, by definition only one valxie (represented by 
point 719) is provided to the channel. Therefore any subsequent response such as values 721 , 
723, 725 or 727 do not represent valid values v^ch have been provided to the channel. Values 
721, 723, 725 and 727 instead represent intersymbol interference caused by the impulse fiinction. 
Samples 721, 723, 725 and 727 may be caused by the dispersion of the impulse waveform within 

20 a multimode fiber and are an undesirable feature of the fiber channel. They are generally caused 
by the differing propagation times of the impulse through different modes of the fiber. An 
equalizer, such as the illustrated DFE 625 may compensate for the distortion uitrodiiced by 
samples such as 721, 723 » 725 and 727. The decision fsedbadc equalizer uses an adaptive 
transversal filter 7 11 to generate a waveform equivalent to the trailing edge 73 1 of the impulse 

25 response. The trailiiig edge, represented by 731, is the portion ofthewavefonn immediately after 
the sampled point 719 which includes spurious response points 721, 723, 725 and 727. The 
portion of the waveform 719 represents the spurious response of the channel. The adaptive 
transversal filter 623 makes a copy of the spurious response and subtracts it from the overall 
channel response in summation unit 619. The adaptive transversal filter is termed adaptive 

30 because it must adapt itself to the characteristics of the channel. In other words, the adaptive 
transversal filter must be trained using the chaimel characteristics in order to derive the proper 
response that will be provided to the summation unit 619. Once the slicer 621 detects which 
symbol is present, the adaptive transversal filter can then provide the response necessary to cancel 
the intersymbol interference present that would accompany the transmitted point. 

35 The received waveform at a point prior to the summation unit 619 is shown on 

oscilloscope 6 1 5 as display 6 1 5 A. Display 6 1 5 A is a scatter type waveform that does not exhibit 
distinct levels. The waveform 631 may be generated by the adaptive transversal filter 61 1, in 
order to cancel the intersymbol interference (1ST) within the channel. 

-10- 
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1 Once the intersymbol interferes 

unit 619, the output of the summation unit appears as sho^ on oscilloscope 617, in display 
617A. Displ^ 61 7A represents an eye diagram having five discrete levels. Once the levels have 
been well defined, as seen on display 617A, tiie slicer 621 is able to distinguish relatively easily 

5 between the symbols. The adaptive transversal filter 623 will respond to whatever symbol is 
found by the slicer 623 and provide the necessary waveform to cancel the intersymbol 
interfisrence caused by tiie f3und symbol's transmission. The transversal filter generating an 
intersymbol interference replica, wiiich must be subtracted firom the incoming signal. The 
intersymbol interference waveform changes, depending on which symbol has been found by the 

10 slicer. The ou^ut of the dedsion feedback equalizer depends on the previously decoded 
symbols. The PAM-5 symbols found are then decoded by the Physical Coding Sublayer (PCS) 
521 and then provided to an interface such as a XGMII inter&ce (not shown). 

To further set forth the inventive concepts, a preliminary simulation study of a PAM-5 
system is discussed. To simulate the PAM-S system a laser model was created using rate 

1 5 equations. Pseudo-random PAM-S data was introduced to the laser model. Ihe output from the 
laser model was provided to fiber model. The fiber modeled was a multimode type fiber modeled 
as a linear system with Gaussian Impulse Response. In one example a 62.S/12S fxm fiber having 
a bandwidth of 1 GHZ conveys a loss nanometer signal. 

The Nyquist theorem establishes that the bandwidth needed to transmit data at a rate 

20 = 1/T, without intersymbol interference, must be larger than or equal to V^ T. Many 
conunimication systems however, signal at rates faster than O.S F^, using special techniques to 
control the intersymbol interference. Such techniques have been used in the 100Base-TX and 
lOOOBase-T Ethemet transceivers. The present model examines signaling at 5 GBaud over 
multimode fibers with 1 GHZ bandwidth. The present simulations contemplate signaling at 2.5 

25 times the Nyquist rate (data rate equals 10 Gb/s, baud rate F,, = 5 GHZ, bandwidth equals 1 
GHZ). This bandwidth assumption is consistent with 500 meters of 160/500 MHz-KM fiber at 
1350 nanometers (nm), or 160 meters of the same fiber at 850 imi. 

The model also assumes a receiver having a DFE as illustrated in Figure 6. It is 
recognized that equivalent equalization can be accomplished at the transmitter through the use 

30 of THP, DLP or other equalization techniques. 

The rate equations used in modeling the laser are described in "On Approximate 
Analytical Solutions of the Rate Equations for Studying Transient Spectra of Injection Lasers", 
by D. Marcuse and T.P. Lee, IEEE Journal of Quantrum Electronics, September 1983. The 
equations of the computer model are solved numerically using a fourth order Runge-Kutta 

35 Algorithm. The bias current in the equations was set to three times Ithreshow ^ addition, a 6dB 
extinction ratio is used. 

Figure 8 is a block diagram illustrating a channel model used in conjunction with the rate 
equations. In Figure 8, a pseudo-random PAM-5 symbol generator jSOl provides symbols to the 
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1 la^model803. The ou^litoftlie laser modd is then provided to a midti^ 
The fiber model 805 is a lineai systCTi having a Gaussian impulse response. 

Figure 9 is a graphic representing the impulse response of a linear system having a 
Gaussian in^iulse response convolved vnSi a single pole high pass filter with comer firequency 

5 of 200 MHz. For the simulation, the fiber channel is modeled as in an article ^^ualization of 
Multimode Optical Fiber Systems," by BL. Kaspers, Bell Systems Technical Journal, September 
1982. The Kaspers' model comprises a linear dispersive system witii a Gaussian impulse 
response given by equation 1 . Such Gaussian impulse response models are common throughout 
the literature and are considered to be fiuriy accurate for fibers in v^ch all modes are excited 

1 0 equally Q.e. multimode fibers in an overfill launch condition). 



25 



^l2^ -a I 



15 (Equation 1) 

Where T is the period and a is a system dependent variable related to the bandwidth of the fiber. 
Hie corresponding firequency response of the channel is given by equation 2. 

20 (Equation 2) 

The 3 dB bandwidth of the fiber is given by a equation 8 for a given baud period equal to 3 00 
pico seconds. 



_ 0.1325 



aT 

(Equation 3) 

If the 3 dB bandwidth of the system is assumed to be one gigahertz, the value of ^ is equal to 
30 0.6625. 

Figure 10 is a graph illustrating the output of a las^ model based on the rate equations. 
The vertical axis 1001 represents the intensity of the laser. 

As can be seen from Figure 10, the signal appears to be somewhat noisy. The noise is 
partially accounted for by relaxation oscillation of the laser. Each time there is a sharp transition 
35 in the laser signal, overshoot and ringing results, as depicted in the graph of Figure 10. 

Figure 1 1 is a magnified portion of the graph of Figure 10. Figure 1 1 is included to 
illustrate the ringing present within the waveform of Figure 10. 

Figure 1 2 is a graph of the waveform of Figure 10 after passage throxigh the fiber channel 
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1 model, la odier words, Figure 12 is an illustration of the wavefozm presented to the receiver. 
As can be readily £q>preciated by observing Figures 10 and 12, the fiber channel performs 
significant filtering on &e output of the laser. In ofter words, Figxire 12 is a convolution of the 
waveform m Figure 1 0 with the impulse response of the channel as illustrated in Figure 9 . 

5 Figure 13 is an eye diagram of a sinnilated equalizer at the transition between a training 

mode and receiving PAM-S symbols. 

Hie simulated signal of Figure 12 is introduced to a receiver in Figure 13. The receiver 
used is one such as illustrated in Figure 6. The eye diagram depicted in Figure 13 is the output 
of the decision feedback equalizer 625 of Figure 6. The portion of the graph in Figure 13 

10 delineatedby 1301rq>resentsascatterdiagramequivalenttotfaedispky61S(a)ofFigu^ The 
scatter diagram results afier data has begun ent^ing the receiver and being processed by the slicer 
but the equalizer has not yet been trained. In other words, fte adaptive transversal filter has not 
yet adapted to the characteristics of the channel. A portion of the graph illustrated at 1303 in 
Figure 1 3 is an illustration of the equalizer being trained using two level symbols. At point 1 3 1 S, 

1 5 within Figure 13, the five level Pam alphabet is transmitted to the receiver. The results of the 
receiving of the five level Pam -S alphabet in the trained decision feedback equalizer 625 is the 
five levels 1305, 1307, 1309, 131 1, and 1313 depicted m Figure 13. Figure 14 is a graph 
of a magnified portion of the graph of Figure 13, illustrating the convergence of the equalizer 
during a training sequence. 

20 Figure 14 is a time ejqpansion of the section 1301 of Figure 13, As can be seen fi:om 

Figures 1 3 and 1 4, high data rates can be achieved using pulse amplitude modulation despite the 
presence of mner symbol interference, which may result &om signaling faster than the Nyquist 
rate. 

As can be seen firom the models used to simulate the PAM-5 system transmitting data a 
25 &ster than the Nyquist rate is viable using the techniques disclosed. Additionally using 
multilevel symbols has been shown to be viable and may be used to increase the data rate across 
fiber channels. The redxiced noise tolerance of the system due to the reduced distance between 
signaling levels of a multilevel signaling system may be counteracted by the use of trellis coding 
the signals transmitted. 

30 Supplemental material with regard to the invention here and above desaibed in Appendix 

A entitled "lOGb/s PMD Using PAM-5 TrelUs Coded Modulation". 



35 
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WHAT IS CLAIMED IS: 

1 . A method for high-speed transmission of infonxiation data on an optical channel, 
the method comprising: 

encoding information via a trellis encoder to produce digital multilevel symbols; 
converting the digital multilevel symbols into analog mxittilevel signals; and 
transmitting the analog multilevel symbols over an optical channel. 

2. The method of claim 1 further comprising equalizing the digital multilevel symbols 
to compensate for characteristics of the optical channel. 

3. The method of claim 1 further comprising of equalizing the analog multilevel 
symbols to compensate for characteristics of the optical diannel. 

4. The method of claim 2 \^^ereih equalizing the digital multilevel symbols comprises 
precoding the digital multilevel symbols using a Tomlinson Harashima precoder. 

5. The method of claim 2 wherein the equaliang the digital multilevel symbols 
comprises precoding the digital multilevel symbols usmg a dynamic limiting precoder. 

6. The method of claim 1 wherein the converting the digital mxiltilevel symbols to 
analog multilevel symbols includes mapping the digital multilevel symbols into a subset mapper. . 

7. The method of claim 1 wherein transmitting the analog multilevel symbols over an 
optical chaimel comprises modulating the intensity of a Ught source according to the level of the 
analog multilevel symbols. 

8 . The method of claim 1 A\toein transmitting the analog multilevel symbols over an 
optical channel comprises modulating laser intensity according to a level of the analog multilevel 
symbols. 

9. A method as in claim 2 wherein equalizing the digital multilevel symbols to 
compensate for the laser and channel characteristics comprises: 

characterizing the channel; and 

applying an inverse characterization of the channel to the digital multilevel 
symbols; 

10. A method as in claim 2 wherein equalizing the digital multilevel symbols to 

.14. 
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1 compensate for the laser and channel characteristics comprises: 
charact^iztng the diannel; and 

applying an inverse characterization of the channel to the analog multilevel 
symbols. 

5 

11. A method for hig^ speed transmission on an optical channel, the method 
comprising: 

accepting infonnatian from a plurality of sources; 

encoding the information via a plurality of trellis encode to produce a plurality 
10 of digital multilevel symbols; 

converting the plurality of digital multilevel symbols into a plurality of analog 
mxihilevel signals; and 

transmitting the analog mxiltilevel signal by time division multiplexing the plurality 
of analog multilevel signals onto an optical channel. 

15 

12. A method as in claim 1 1 wherein converting the plurality of digital multilevel 
symbols to analog multilevel signals further comprises: 

mapping the digital multilevel symbols in a subset mapper; and 
forming analog multilevel symbols by providing analog represratations of mapped 
20 multilevel signals. 

13. The method of claim 1 1 further comprising eqiializing the plurality of digital 
multilevel symbols to compensate for characteristics of the optical channel. 

25 14. The method of claim 11 further comprising equalizing the plurality of analog 

multilevel symbols to compensate for characteristics of the optica] channel. 

15. The method of claim 13 wherein equalizing the digital multilevel symbols 
comprises precoding the plurality of digital multilevel symbols iising a Tomlinson Harashima 

30 precoder. 

16. The method of claim 12 wherein equaUzing the digital multilevel sjanbols 
comprises precoding the plurality of digital multilevel symbols using a dynamic limiting 
precoder. 



35 



17. The method of claim 1 1 wherein converting the plurality of digital multilevel 
symbols into a plurality of analog multilevel symbols fiather comprises: 

accepting the plurality digital multilevel symbols into a subset mapper; and 
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1 foiming a plurality of mapped analog multilevel symbols fiom tke plurality of 

digital muMlevd symbols. 

1 8. The method of claim 1 1 A^^ierein transmitting the plurality of analog multilevel 
5 symbols over an optical channel comprises modulating the intensity of a light source according 

to the levels of the plurality of analog multilevel symbols. 

19. The method of claim 11 wherein transmitting the plurality of analog multilevel 
symbols over an optical channel compiises modulating the intensity of a laser according to the 

1 0 level of the analog multilevel symbols. 

20. The method as in claim 12 wherein equalizing the digital multilevel symbols to 
conq)ensate for the laser and channel characteristics comprises: 

characterizing the diannel; and 
15 applying an inverse characterization of the chaimel to the digital multilevel 

symbols. 

21. . The method as in claim 12 v^erein equalizing the digitEd multilevel symbols to 
compensate for the laser and charmel characteristics comprises: 

20 characterizing the channel; and 

^plying an inverse characterization of the channel to the plurality of analog 
multilevel symbols. 

22. The method as in claim 1 1 wherein converting the plurality of digital multilevel 
25 symbols into a plurality of analog multilevel signals comprises: 

accepting the plurality digital multilevel symbols successively into a single analog 
to digital converter; and 

successively converting the plurality of symbols into analog multilevel symbols. 

30 23. The method as in claim 1 1 wherein converting the plurality of digital multilevel 

symbols into a plurality of analog multilevel signals comprises: 

accepting the digital multilevel symbols successively into a plurality of analog to 
digital converters; 

converting the plurality of symbols into an analog representation; and 
35 successively combining the analog multilevel symbols into a succession of analog 

multilevel symbols. 

24. A method of receiving data from an optical charmel the method comprising: 
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1 acceptiiig a multilevel signal fiom the diaimel into an optical to electrical 

converter; 

converting the multilevel signal izito an analog electxical signal; 
converting the analog electrical signal into a digital signal; and 
5 decoding &e digital signal in a trellis decoder. 

2S. The method of claim 24 further comprising equalizing the digital signal prior to 
decoding the digital signal in the trellis decoder. 

1 0 26. The method of claim 25 wherein equalimg the digital signal ooiiq)iises applying 

a decision feedback equalization to the digital signal. 

27. A method as in claim 24 herein converting the analog electrical signal to a digital 
signal comprises: 

1 5 successively sampling the analog electrical signal; and 

converting the successive samplmgs into a plurality of parallel digital values. 

28. A method of signaling over an optical channel the method comprising: 
accepting data from a source; 

20 trellis encoding the data; 

coupling the encoded data into an optical channel; 

conveying the data over the optical channel; 

accepting data from the optical channel 

decoding the data accepted fi:om the optical channel; and 
25 providing the decoded data to an interface. 

29. A method as in claim 28 further comprising: 
equalizing the data after trellis encoding the data. 

30. A method as in claim 29 Therein equalizing the data comprises applying a 
30 Tomlinson-Harashima precoding to the data. 

31. A method as in claim 3 0 wherein equalizing the data comprises flying a dynamic 
limited precoding. 

35 32. An apparatus for transmitting information on an optical channel to apparatus 

comprising: 

a trellis encoder for accepting digital information and producing digital multilevel 
signals; 
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1 a digital to analog converter that accepts die digital multilevel signals and produces 

analog multilevel signals; and 

an analog signal to optical converter tiiat converts the analog signal to an optical 
level for coiq>ling into an optical channel. 

5 

33. The apparatus of claun 32 further comprising an equalizer that accepts the digital 
multilevel signals and produces equalized digital multilevel signals prior to coupling into the 
digital to analog. 

10 34. The apparatus of claim 32 fblher comprising an equalizer that accepts tfa^ 

multilevel signals and produces equalized analog multilevel signals. 

35. An apparatus as in claim 33 vdierein tfie equalizer is a Tomlinson-Harashima 
precoder. 

-15 

36. An apparatus as in claim 33 wherein the equalizer is a dynamic limiting precoder. 

37. An apparatus as in claim 32 i^erein the analog signal to optical level converter 
mcludes a laser. 

20 

38. An ^aratus for concuiiently transmitting a plurality of data signals over an optical 
channel, the £^paratus comprising: 

a pliirality of trellis encoders that accept a pliirality of data signals and produce a 
plm^ity of digital multilevel signals; 
25 . a converter that accepts a plurality of digital multilevel signals and produce a 

plurality of analog multilevel signals; 

an optical source that receives the plurality of analog multilevel signals and 
produces a light output proportional to the level of successive analog multilevel signals 
for driving an optical channel. 

30 

39. An apparatus as in claim 38 further comprising a plurality of equalizers that accept 
the plijrality of digital multilevel signals and produce a plurality of equalized digital multilevel 
signals to provide to the converter. 

35 40. An apparatus as in claim 39 wherein the plurality of equalizers comprise aplurality 

of Tomlinson-Harashima precoders. 

41. An apparatus as in claim 39 wherein the pluraUty of equalizers comprise a plurality 
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1 of dynamic limiting precodeis. 

42. An apparatus for conctarently transmitting aplurality of data signals over an optical 
channel the apparatus comprising: 

5 aplurality of trellis encoders that accept a plurality of data signals and produce a 

plurality of digital multilevel signals; 

an analog to digital converter that sequentially 8ccq>ts the plurality of digital 
multilevel signals and piodxices aplurality of sequential analog multilevel signals; 

an optical source that receives the plurality of analog multilevel signals for driving 
10 an optical channel. 

43. An apparatus as in claim 38 further comprising aplurality of equalizers that 

the plurality of digital miiltilevel signals and produce a plurality of digital multilevel signals. 

15 44. An apparatus as in claim 43 herein the plurality of equalizers comprise a plurality 

of Tomlinson-Harashima precoders. 

45. An apparatus as in claim 43 wherein the plurality of equalizers comprise aplurality 
of dynamic limiting precoders. 

20 

46. An apparatus for receiving data from an optical channel the apparatus comprising: 
an optical to electrical converter for receiving an optical multilevel signal from an 

optical channel and convaUng the optical multilevel signal into an analog multilevel 
electrical signal; 

25 a decoder that accepts the analog multilevel electrical signal and converts it into 

digital multilevel signal; 

a trellis decoder that accepts and decodes the digital multilevel signal producing 

data« 

47. The apparatus of claim 46 further comprising an equalizer for accepting the digital 
30 multilevel signal and producing a digital equalized multilevel signal for coupling into the trellis 

decoder. 

48. An apparatus as in 47 wherein the equalizer is a decision feedback equalizer. 

35 
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